Genetic Algorithm (GA) 


Traveling Salesman Problem 


¢ Is aclassic optimization 
problem in which a salesman 
must visit a set of cities, each 
exactly once, and return to the 
starting city. 


¢ The goal is to find the w 
shortest possible routethat <=. 
satisfies these conditions. 
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The Genetic Algorithm (GA) 


¢ Developed by John Holland, University of Michigan (1970’s) 
¢ To understand the adaptive processes of natural systems 


¢ To design artificial systems software that retains the robustness of natural 
systems 


¢ His aim was to make computers do what nature does - Holland 
was concerned with algorithms that manipulate strings of binary 
digits 


Genetic Algorithm (GA) 


¢ Represent problem variable domain as a chromosome 
(individual) of a fixed length, choose size of population N, 
crossover probability pc, mutation probability pm 


¢ Define a fitness function to measure performance of an individual 
(chromosome); fitness function establishes basis for selecting 
chromosomes that will be mated during reproduction. 


GA Steps 


¢ Step 1: Randomly generate an initial population of 
chromosomes of size N: 


Xq9Xo 92009 Xn 
¢ Step 2: Calculate fitness of each individual (chromosome). 


¢ Step 3: Select a pair of chromosomes for mating from current 
population; parent chromosomes are selected with a 
probability related to their fitness 


¢ Step 4: Create a pair of offspring chromosomes by applying 
genetic operators - crossover and mutation 


GA Steps 


¢ Step 5: Place created offspring chromosomes in new 
population 


¢ Step 6: Repeat Step 5 until size of new chromosome 
population becomes equal to size of initial population N 


¢ Step 7: Replace initial (parent) chromosome population with 
new (offspring) population 


¢ Step 8: Go to Step 2, and repeat process until termination 
criterion is satisfied 
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Genetic Algorithm (GA) 


¢ GA represents an iterative process; each iteration called a 
generation (~ 50 to over 500); entire set of generations is called a run 


¢ GAs use a stochastic search method, fitness of a population may 
remain stable for a number of generations before a superior 
chromosome appears 


¢ Common practice is to terminate a GA after a specified number of 
generations and then examine best chromosomes in population; if 
no satisfactory solution is found, GA is restarted 


Hyperparameters of GA 


* Chromosome population Number of individuals in the population. 


Probability of performing crossover 


Crossover probability (recombination) between two parents. 


* Mutation probability Probability of mutating an individual's 


genes. 


Genetic Algorithm (GA) 


¢ Each artificial “chromosome” (individual) consists of a number of 
“senes”, and each gene is represented by 0 or 1: 
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¢ GA uses a measure of fitness of “chromosome?” (individual) 
chromosomes to carry out reproduction: 
e Crossover operator 
¢ Mutation operator 


Genetic Algorithms: Example 


Find maximum value of function (15x — x7) where 0 § x § 15 (x only integer 
values) 


¢ Chromosomes built with only four genes: 


Integer | Binary code\ Integer | Binary code| hteger | Binary code 
| - 


Hyperparameters of GA 


Chromosome population N =6 
Crossover probability P, = 0.7 
Mutation probability P,, = 0.001 


Fitness function is defined by: 


f(x) = (15x — x’) 


step 1: Initial population 


Chromosome Chromosome 
label string 


step 2: Fitness Function and Chromosome 
Locations 


Chromosome | Chromosome Decoded Chromosome 
label string integer fitness 


Step 3: Selection 


¢ Selection in Genetic Algorithms (GA) determines which individuals 
from the current population are chosen to reproduce and form the 
next generation. 
¢ Roulette Wheel Selection 
¢ Tournament Selection 
¢ Random Selection 
¢ Truncation Selection 


How Roulette Wheel Selection Works 
(Maximum problem): 


1.Assign Probabilities: Each “chromosome?” (individual) in the 
population is assigned a probability proportional to its fitness: 


ea fj 


where f; is the fitness of the i-th individual, and n is the population size. 
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2. Cumulative Probability: Compute the cumulative probability for 
each “chromosome”. 


3. Random Selection: Generate a random number 1r,, in the range [0,1) 
(Spin) . 
4. Repeat: Repeat the step 3 for the desired number of selections. 


Assign Probabilities 


Chromosome | Chromosome /DY=Yereye[=\e! Chromosome 
string integer fitness 


Cumulative Probabilities 


Chromosome 


Chromosome 
label 
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string 
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integer 


. Cumulative Probabilities 
fitness 


CP,=16.5% 


CP, = 16.5 +20.2 = 36.7% 


CP, =36.7+ 6.4 = 43.1% 


CP, =43.1+ 6.4= 49.5% 
CP, =49.5+ 25.7 = 75.2 % 
CP, =75.2+ 24.8 = 100 % 


Chromosome : Cumulative Probabilities | Cumulative Probability 
Range (CP) 

CP, =16.5% O<=r, <0.165 
CP. = 36.7% 0.165 <= 7, <0.367 
CP, =43.1 % 0.367 <=r, < 0.431 
CP, =49.5 % 0.431 <=r, <0.495 
CP, = 75.2% 0.495 <=r, <0.752 
CP, = 100 % 0.752<=r, <1.0 


LI X1: 16.5% 
Mm X2: 20.2% 
LI X3: 6.4% 
M x4: 64% 
MM X5: 25.3% 
M X6: 24.8% 


Selection 


¢ The number of spins equals the population size (n). 


¢ If n=6, you spin the roulette wheel 6 times to select individuals for the 
next generation. 


¢ To establish same population in next generation, roulette 
wheel would be spun six times 


¢ Once a pair of parent chromosomes Is selected, crossover 
operator is applied 


¢ Suppose the following pairs are selected: 
(X6, X2), (X1, X5), (X2,X5) 


Crossover 


¢ Crossover is performed on two parents to form two new 
offspring. 

¢ The GA has a crossover probability (Pc) that determines if 
crossover will happen. 


¢ For each pair of selected parents, generate a random number r, 
between 0 and 1. 
¢ Ifr,s Pc, perform crossover to produce offspring. 
° Ifr,> Pc, pass the parents unchanged to the next generation. 


Single Point Crossover 


¢ How Single Point Crossover Works: 
i. Select a Crossover Point: 
* Randomly choose a position (index) r,,, within the length of the parent strings. 
li.Split the Parents: 
¢ Divide the parent strings at the selected crossover point. 
lii.Exchange Segments: 


¢ Create offspring by combining the first part of one parent with the second part of the 
other. 


Two-Point Crossover 


¢ How Two-Point Crossover Works: 
i. Select Two Crossover Points: 
* Randomly choose two crossover points (r 
li.Split the Parents: 


¢ Divide each parent into three segments: one before the first point, one between the 
two points, and one after the second point. 


lii.Exchange the Middle Segments: 
¢ Create offspring by swapping the middle segments of the parents. 


cp1, “cp2) Within the parent strings. 


Crossover — Single point 


r, =0.24, r,s Pc 


r,=0.14,7r,s Pc 


x2, [OGo[o) (OG xs, | r.=0.71,r,> Pc 


Mutation 


¢ Mutation represents a change in gene 

¢ Mutation probability is quite small in nature, and Is 
kept low for GAs, typically in the range between 0.001 
and 0.01 

¢ Mutation operator flips a randomly selected geneina 
chromosome 

¢ Its role is to provide a guarantee that search algorithm 
is not trapped in a local optimum 


Mutation 
Mutation probability P,, = 0.001 
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